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1. Introduction 

The concept of 'small world' networks [T] was introduced as an attempt to capture 
and study nontrivial features observed in realistic biological, technological and social 
networks. The key idea is to generate a structure which interpolates between a regular 
finite dimensional one and a sparse random long-range one. In a typical construction 
one starts with a locally regular network, e.g. a ring, where each site is connected to its 
2k nearest neighbours, and subsequently 're-wires' randomly with a probability p those 
local connections, creating long range shortcuts. One characteristic of networks of this 
type, the so called 'small world effect', is that even for small p the average minimal 
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Figure 1. Example of a 'small world' lattice connecting N spins (indicated by •) 
in the sense of our present models. Nearest neighbour interactions along a one- 
dimensional ring are combined with sparse long-range interactions in the form of a 
random Poissonian graph, with small average connectivity c. Here N = 100 and c = 2. 



path length between two sites can still be very small. Small world networks have also 
attracted a lot of attention in physics [21 El IH El IHl • A study of an Ising model [3] on a 
small world network showed that even for very small re-wiring probability p there exists 
a ferromagnetic phase transition at finite temperature, which is absent in the purely 
one-dimensional model. From a statistical mechanics point of view, the 'small world 
effect' can thus be thought of as inducing global order in a low- dimensional system by 
adding a small number of long range connections. 

In this paper we study a family of Ising spin models defined on a lattice which, 
although not identical to the construction of jl], shares with the latter the 'small world' 
characteristics of a regular short-range structure in coexistence with a sparse and random 
range-free one. Our lattice consists of a one-dimensional ring of sites occupied by 
Ising spins, where each site is firstly connected to its nearest neighbours, and secondly 
via a random Poissonian graph in which the average number of connections per site c 
remains finite in the thermodynamic limit oo. See e.g. figure ^ This architecture 
was also studied in [4^ ; however, the author of 4j did not attempt to calculate transition 
lines or phase diagrams analytically, but resorted to an annealed approximation. We 
take the bonds between nearest neighbours on the ring to be ferromagnetic, whereas 
the long-range bonds can be random. Our motivation for studying this structure is 
twofold. Firstly, our model is a combination of a one- dimensional system and a random 
finitely connected graph so its mathematical analysis is nontrivial yet feasible, requiring 
an interesting mixture of mathematical tools developed for one-dimensional models (the 
transfer matrix technique) and those developed for finite connectivity models. Finite 
connectivity techniques have been applied to many areas, such as error correcting codes 
(3 012] , theoretical computer science [101 IHl US CHI , neural networks jTH HHj , and spin 
glasses [ini im CHI 1201 1211 1221 12n| • in the later field, research has been triggered by the 
desire to develop solvable spin-glass models which are closer to real finite-dimensional 
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systems than the fully connected spin-glass model of j2S]- The RKKY interactions of 
metallic spin-glasses can be regarded as a combination of short-range ferromagnetic 
bonds and long-range random ones. Thus there is a case for regarding our 'small world' 
networks, which are defined with a similar structure of spin-interactions, as perhaps 
more realistic than finite connectivity spin-glass models. This is our second motivation. 

At a technical level, upon calculating for the present class of models an expression 
for the disorder-averaged free energy per spin using the replica formalism, one is led to 
a replicated transfer matrix structure embedded within a mean-field finite-connectivity 
type calculation. Solving our models thereby boils down to the diagonalization of 
specific 2" x 2" replicated transfer matrices, in the limit n 0. We show how this can 
be done within the replica symmetric ansatz, and we use the result to calculate fully 
explicit expressions for transition lines, phase diagrams, and effective field distributions. 
Numerical simulations show perfect agreement with our theory. 

Upon completion of this study, a preprint was communicated [2Zj in which the 
authors also aim to solve an Ising model on a small world lattice explicitly. However, 
both their methods (combinatorics rather than replicated transfer matrices) and model 
definitions (regular rather than random long-range sparse connectivity) differ from those 
in the present paper. 

2. Definitions and replica analysis 

Our model is a system of N interacting Ising spins o"i G { — 1,1}, in thermal equilibrium 
at inverse temperature /3 = 1/T, described by the following Hamiltonian (defined with 
aN+i = cTi): 

H = -Jo'^aiCXi+i ^JijCijCTiaj (1) 

i ^ i<j 

The (long-range) couplings Jij G IR are independent identically distributed random 
variables, drawn from some distribution p{Jij). We will abbreviate JdJ p{J)g{J) = 
{g{J))j. The variables Cij G {0,1} specify whether a long-range bond between sites 
i and j is present (c^ = 1) or absent (q^ = 0); they are also independent random 
variables, drawn according to 

= + (l - ^) ^c.„o (2) 

This choice leads in the thermodynamic limit — oo to a number of long range 
connections per site distributed according to a Poisson law with mean c. The number c 
will remain finite in the thermodynamic limit N ^ oo. Equilibrium ensemble averages, 
with the conventional Boltzmann measure for spin configurations, will simply be denoted 
by (...). The dilution variables and long-range bonds {cij,Jij} represent quenched 
disorder, with respect to which all macroscopic thermodynamic quantities are assumed 
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to be self averaging in the limit N oo. We will write disorder averages as [...]. 

We calculate the asymptotic disorder-averaged free energy per spin in the 
conventional manner using the replica formalism, which is based on the identity 

7= - hm -3-lim-logZ^ Z= y e-f^" (3) 

f cri,...,(Tjv 

As usual, the disorder average is performed for integer ra, the order of the limits N ^ oo 
and n ^ is reversed, and the final result is extended to non-integer n to allow the 
limit n to be taken. We will denote n-replicated spins by cTj = (cr^, ... , cr^), and 
abbreviate {cr} = {cri,...,crjv}- Averaging over the disorder now gives 



This expression can be transformed into an integral to be calculated by steepest descent 
as N ^ oo, via the introduction of the order parameter distribution P{s; {cr}) = 
N''^ J2i ^s,(Ji- This latter observable gives the fraction of sites with a given configuration 
s G {—1, 1}" of replicated spin variables [21]. In particular we find 

Z^= fU [dP{s)dP{s)] e^*"^'^" (5) 
s 

S ^ S,S' 

In the limit N ^ oo the integral ^ is dominated by the stationary point of ^'[{-P, P}]- 
Working out the equations 9^/(9P(s) = d'^/dPls) = 0, for all s, gives respectively 

PW = icX;PM{e'¥«-«'-l), (7) 

^ ^ N^oo J2{a} (^'^'^"^'^''^'^^^'^'^^^"^ 

We use (jTj) to eliminate the conjugate order parameters. To proceed further we define 
a 2" X 2" transfer matrix T[P] and a diagonal 2" x 2^ matrix Q[s], with entries 

Qcr,a'[s\ = 5s,a5(T,(T' (10) 

These definitions allow us to write the replicated spin summations as traces of matrix 
products, so that, upon inserting into (jHl), the latter becomes 

Pis) - lim ^y MT'-\P]Q\s]T''-'»\P]) _ tr(QMT"|P]) 
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Only contributions from the largest eigenvalue X{n; P) of survive the limit oo. If 

we denote by v[P] and u[P] the associated left and right eigenvectors, with components 
fcr[-P] and Ucr[P], we arrive at the following expressions for (fTT|) and the free energy: 

Pis) = (12) 

7 = lim^|^cEP(«)P(^')(e^"-^'-l)i-logA(n;P)| (13) 

In order to proceed we next need to solve the eigenvalue problem for the replicated 
transfer matrix T[P] as defined in (jH)). This is generally a nontrivial task, therefore in 
the remainder of our paper we will focus on the replica symmetric solution. 



3. Solution by diagonalization of RS replicated transfer matrix 

3.1. Conversion to a functional eigenvalue problem 

The ergodic, or replica symmetric (RS), ansatz corresponds to the distribution P{s) 
being invariant under all permutations of the replica labels {1, . . . ,n}. Now P{s) can 
depend on s only via the sum J2a=i Sa, and may thus always be written in the form 

/n pl3hsa 

where the new RS order parameter W{h) is a (normalized) distribution of effective fields 
/ij, which are defined via (o"j) = tai\h{(3hi) . Let us next define the following short-hand: 

[2 cosh(/3/i)]" 



w ^ 

a s' 



where 



cosh[/3(J + z) 



MJ, ^) = ^ log 



cosh[/5( J - z)] 



— arctanh[tanh(/3J) tanh[/32;)] 



B{J, z) = ^ log [4 cosh[/3( J + z)] cosh[/3( J - z) 
This allows us to write the entries of our transfer matrix within the RS ansatz as 

''dm P(m, n) 6^-^°'^"'^"-'^'^'"- (16) 



with 



P(m, n)=/3 [— ei/5'^™+'=«'("^.'^)-'= (I7) 

J 271 

The matrix (fTH|l is formally identical to the replicated transfer matrix which would have 
been found for Ising chains with (complex) random fields — irn, distributed according 
to R{m,n). We exploit this equivalence, and postulate eigenvectors with the structure 
as found in one-dimensional random-field models. In particular, for the right and left 
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eigenvectors of the largest eigenvalue of we substitute a form which is a complex 
extension of that introduced in |26j : 

u^= y"dxidx2 $(xi,X2|n) e^(^^+^^'^)S.-- (18) 

<s = J dy,dy2 ^{yi,y2\n) eP^y^+'y^^E.'^'^ (19) 

In one-dimensional models xi + 1x2 and yi + i?/2 would represent fields which are 
propagated along the chain, according to a random Markovian map which reflects the 
statistical properties of the random fields and nearest neighbour interactions. In the 
limit N — >■ 00, $(...!«) and . .\n) give the distributions of these fields, invariant 
under the map. Insertion of ()18I19|) into the eigenvalue equations (to be satisfied for 
every cr), i.e. 

cr' cr' 

leads to new eigenvalue problems for $ and ^, with x = {xi,X2) and y = {yi,y2): 

XYis{n)^{x\n) = Jdx' A^{x,x'\n) ^{x'\n) (20) 

XRs{n)'^{y\n) = Jdy' A^{y,y'\n) ^iy'\n) (21) 
with the complex kernels 

A^{x,x'\n) = [dm R{m,n) e"'^^(-^0'-'i+-^) 5 ( ~ Re{A(Jo,x;+ i^) - im} \ 
^ ' ^ J ^ ^ \x2-lm{A{Jo,x[+ix'2) -im} J 

AAy,y'\n) = fdmR{m,n) ^nmJo,y[yW,-in.) J Vi ' AiJo,y[+ iy'- 

J \y2-lm A{Jo,yi+iy2-im) J 

In order to find a self-consistent equation for the RS order parameter W{h) in (jl4j) we 
need to inspect only the — > limit of the eigenvalue problems ()20I2H) . For the free 
energy, however, we need to know the first two orders in n of the eigenvalue ARs(n). 

3.2. Derivation of the RS order parameter equation 



Upon taking the limit n — >■ we find the kernels ()22l23p reducing to 

A,(., a.'|0) = /dm Rirn, 0) 6 ( ' f ^jf^t ' 1 ^ " ) ^ 
^ ' ^ J ^ ^ \x2-lm{A{Jo,x[+ix'2) -im} J ^ ' 

Am>U/,2/ = / dm m,0 5 , . 25 

Subsequent integration of the eigenvalue equations ()20l2ip over x and for n — >• and 
using /da; $(a3|0) > and jdy \E'(?/|0) > (since $ and represent field distributions), 
leads in both cases to the following identity 

Ars(O) = ydm i?(m, 0) = e'="'(°'°)-'= = 1 (26) 
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which is indeed necessary for the n — hmit in (|13p to exist. Knowing Ars(O), we may 
in turn write the two n eigenvalue problems as 

We now expand e'^"''^™''°^ in powers of c, using w{m,0) = Jdh W{h){e^'^'^^'^''^^) j: 



fc>0 

We assume our functions to decay to zero sufficiently fast away from the origin to allow 
us to shift the z-integration in the complex plane according to z ^ z + iP J2e=i ^{^^hc). 
This enables us to perform the integral over m, giving 27r6{z), and write 

$(x|0) = fdx' ^x'\0) ^ / n [dhd JiW{hMJi)] 

k>o e=i 

[x2-lm{A{Jo,x[+ix',)+ELiA{^,h,)} J ^ ' 

^{y\Q) = fdy' ^{y'\Q) ffl [dhMW (hM-Ji)] 

k>o e=i 

/ 1/1 - Re A{Jo, y[+ iy',+ ELi A{^, h,)) \ 
U2-ImA(Jo,i/i+ii/^+Eii^(f,M)y ^ ^ 

These eigenvalue equations allow for solutions describing the expected manifestly real- 
valued fields, i.e. $(xi,X2 |0) = (5(x2)$(xi) and ^'(yi, 1/2IO) = 5(?/2)^(l/i), where 

$(a;) = / dx' Y ^ / n [dhidJ,W{h,)p{J,)] 
•' k>o ^- •' e=i 

k T 

x6[x-A{Jo,x')-YM-,he)] (29) 
^{y) = [ dy' ^{y') [U [dhdJeW (hMJe)] 

k>0 i=l 

k T 
. ■Jt 



X 



5[y-A{J,,y'+YA{-M))] (30) 



£=1 ^ 



We may always normalize our solutions such that / dx $(x) = /dy \E'(?/) = 1, which will 
be assumed from now on. Finally, for RS states ()14ll8ll9p with $(xi, X2IO) = 5(x2)$(xi) 
and \E'(?/i, ?/2|0) = 5{y2)'^{yi) we find the self-consistency equation (fT^ reducing to 

Wih)^-^^^ = /d^dy 1>(x)vl/(y)e^(-+^)i:^-° 

^ ^[2cosh(/5/i)]" /dxdy <l>(x)^(?/)[2cosh[/5(x + -'^^" ^ ^ 
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From this we obtain for n = the simple expression 

W{h) = J dxdy ^{x)<i!{y)5[h - x - y] (32) 
The final trio of coupled equations ()29I30I32|) . to be solved simultaneously, determine 



the effective field distributions W{h),^{x),'^{y). The latter functions play the role of 
RS order parameters in our theory. 



3.3. Derivation of the RS free energy 

We now turn to the evaluation of the free energy per spin in RS ansatz, by inserting 
(HH) into (Uni): 



f 



— lim — - 



dhdh' W{h)W{h') 



4cosh(/5/i) cosh(/5/i') 



- 1 



~ 1™ — r logARs(n) 

n^o np 

fdhdh' iy(/i)iy(/i')(log[l + tanh(^)tanh(/3/i)tanh(/?/i')])j 



+ (log cosh - lini ^logARs(ra) 
In evaluating ArsI'^) "we will need the following two identities: 

u;(0, n) =l + n jdh W{h) [l3{B{^, h))j - log[2 cosh(/3/i)]| + 0{n^ 



j dm R{m, n) = e 



cw{0,n)—c 



1 + ncJdh W{h) ^^p{B{^,h))j - \og[2cosh{ph)]^ + Oin^ 



(33) 
(34) 

(35) 



/ dxdx' A^{x, x' 


n) $(a;' 


n) 


Jdx ^{x 


n) 



We can now obtain an expression for Api,s(?T-) by integrating both sides of equation (j2(jp : 
lim - log ARs(n) = lini - log 

, 1, f fda; fdm i?(m,n)e"^^(-^0'^i+^^2) ^^a-u) 

= lim - log <^ r /IN 

n^o n [ jdx ^{x\n) 

= cjdh W{h) [P{B{^, h))j - log[2 cosh(/5/i)] 

+ (3 jdx $(s)5(Jo,x) (36) 
Insertion into (jH^ subsequently gives, after some simple manipulations: 

J^^ = -^ f dhdh' W{h)W{h'){log[l + tanh(^) tanh{(3h) tanh(/3/i')]) J 

-^Uh W{h){\og[l - tanh2(— ) tanh^(/3/i)]) j 

- ^(logcosh(^))j 



1 

2P 



dx $(x) log 4 cosh[/?( Jo + x)] cosh[/?( Jq - x)] 



(37) 
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4. General mathematical properties of our RS equations 



4-1- Special limits 

Let us first confirm that for the two extreme choices p{J) = S{J) (equivalently c = 0, 
where we return to a simple ferromagnetic ring) and Jq = (where we retain only the 
sparse Poissonian graph) we recover from our present full RS theory the appropriate 
simpler equations known from earlier literature, to serve as benchmark tests. 

We will repeatedly benefit from the property ^4(0, z) = 0. For p{J) = 6{J) our RS 
order parameter equations ()29I30|) simply give $(x) = \l'(x) for all x, with 



dx' ^{x')6[x- A{Jo,x')] 



{31 



Any solution $ of this equation can have support only at periodic points of the non-linear 
map X A{Jq, x). Upon writing y = tanh(/5Jo) tanh(/9a;) this map can be simplified to 
y tanh(/3Jo)?/, so the only periodic point is the trivial fixed-point x = 0. It follows 
that the only normalized solution of ()38|) is $(a;) = 6{x), with which we obtain the 
trivial effective field distribution W{h) = S{h), as we should, and the correct free energy 
of the one- dimensional Ising model: 



/rs= -^log[2cosh(/5Jo)] 



(39) 



For Jo = 0, on the other hand, our order parameter equations tell us that \l/(y) = S{y) 
and hence W{h) = ^{h). Now we recover the familiar equation for W{h) corresponding 
to purely Poissonian finite connectivity spin-glass models, which can be found in e.g. 

m 



W{h) 



E 

k>0 

X 6 



k\ 



n \dhMW{h,)p{J,)] 



/i — — ^ arctanh[tanh( ) tanh(/?/i£)] 



(40) 



4-2. Scalar RS observables 

The conventional RS scalar observables such as the magnetization m and the spin- 
glass order parameter q can be obtained as always as integrals over the effective field 
distribution W{h). The starting point are the usual replica identities 



lim 



a {cr} 
1 



7=1 



EE< 



0- 



7=1 



Upon repeating all those manipulations which we followed previously in calculating the 
RS free energy, one arrives at the familiar expressions for m = limjv^oo X^i (^i) s-nd 
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m 



J dh W{h) tanh(/?/i) q = J dh W{h) tanh^iph) (41) 



4-3. Continuous bifurcations away from the paramagnetic state 

Inspection of the three coupled equations ()29|H()pH2j) shows that, due to A{J, 0) = 0, the 
paramagnetic state ^{h) = ^(/i) = W{h) = 6{h) is always a solution. For j3 = (high 
temperatures), where A{J, z) = for any (J, z), it is the only solution. As always in finite 
connectivity theory, we can find continuous bifurcations away from the paramagnetic 
solution (upon lowering the temperature) by assuming that close to the transition the 
effective fields are very narrowly distributed around zero. This enables us to expand our 
equations in moments of the field distributions. We make the ansatz / dh h^^{h) = (9(e^) 
and Jdh h^^{h) = 0(e'=), with |e| < 1, so that also 

m = 13 jdx ^{x)x + (3 jdy'^{y)y + 0{e^) (42) 

q = (3'^ jdxdy ^{x)^{y){x + y f + 0{e^) (43) 

Bifurcations in which the lowest non-zero order is e thus describe transitions towards a 
ferromagnetic state (P^F), and those where the lowest non-zero order is transitions 
towards a spin-glass state (P^SG). The P— >F transitions therefore follow upon 
expanding the first order moments of (j29l30|) . putting x = fdx x$(x) and y = Jdy y'^iy) 
and using A{J, z) = ztanh(/5J) + 0{z^): 

x= tanh(/?Jo)x + c(tanh(^))j(x + y) + C(e^) (44) 

y= tanh(/5Jo)j/ + ctanh(/?Jo)(tanh(^))j(x + y) + 0(e^) (45) 

From this one deduces that a continuous m ^ bifurcation occurs at 

P ^ F : 1 = (tanh(^))j e''^^« (46) 

Similarly we find the P-^SG transitions upon expanding the second order moments of 
()29p3()j) . assuming x = y = and putting = Jdx x'^^{x) and = Jdy y'^'^iy): 

^ = tanh2(/5Jo)^ + c(tanh2(^)) j(^2 + ^) + Oie") (47) 

c 

F= tanh2(/?Jo)^ + ctanh2(/5Jo)(tanh2(^))j(^ + ^) + 0(e3) (48) 

c 

From this one deduces that a continuous bifurcation of g > (while m = 0) occurs at 

P ^ SG : 1 = c (tanh2(— ))j cosh(2/5Jo) (49) 

c 

For /? = the right-hand sides of (j46l49|) are both zero, so the actual (second order) 
physical transition will occur at the highest temperature for which either of the two 
right-hand sides has increased to unity. 

In the next two sections we will work out our theory for two particular simple choices 
for the Poissonian long-range bond distribution p{J). Numerical evidence suggests that 
first order transitions away from the paramagnetic state are absent. 
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5. Small world systems with non-disordered bonds 

We first choose p{Jij) = 6[Jij — J] with J > 0, i.e. uniform sparse long-range 
ferromagnetic bonds (for J < there can obviously never be any transition). 

5.1. The phase diagram 

The second order transition lines and ()49|1 now reduce to 

P ^ F : 1 = c tanh(^) 6^"^° (50) 

c 

P ^ SG : 1 = c tanh\—) cosh(2/3Jo) (51) 

c 

Since cosh(2/5Jo) < e^^-^" and tanh\f3J/c) < tanh(/5 J/c) for J > 0, the P^SG 
instability cannot occur as it will always be preceded by the P^F one. As expected 
we find only the P and F phases. The equation from which to solve the transition 
temperature Tp can be rewritten as 



f3J = Ic log 



C — e~2/3Jo 



(52) 



In the limit c ^ oo we find condition ()52|) reducing to (3J = e~^^"^°. This expression has 
been found earlier in the context of 1 + cxd dimensional attractor neural networks [2lj . 

We note in (jK^ that ferromagnetic order requires pjo > log{l/y/c)] this inequality 
always holds when c > 1, and puts a finite upper bound on Tp when c < 1. Given 
PJo > \og{l/y/c) and Jo > 0, however, there will now always be a solution Tp > 0. 
The simple equation (jS2I) thus reveals the 'small world' effect in statistical mechanical 
terms: for any nonzero average Poissonian connectivity c (including c < 1) and all non- 
zero bond strengths {Jq, J} (however small) there exists a finite transition temperature 
Tf( Jo, J, c) where ferromagnetism sets in. Since the pure Poissonian graph (i.e. Jo = 0) 
would exhibit a transition only when c > 1, above the percolation threshold, this result 
is not obvious. One can apparently induce an overall non-zero magnetization in the one- 
dimensional ferromagnetic ring by adding a very small number of long range connections. 
Similarly, the one-dimensional ring leads to the emergence of a non zero magnetization 
even when superimposed on random graphs with c < 1, below the percolation threshold. 

We have drawn the line in a (/5 Jo, /? J) phase diagram, for different values of the 
average Poissonian connectivity c, in figure El Lowering the temperature from T = oo 
down to T = corresponds in this diagram to moving along a straight line, with slope 
given by J/ Jo, away from the origin (/3Jo, PJ) = (0, 0). 

5.2. Effective field distributions 

To appreciate the physics in the ordered state of the small world magnet, we also solved 



numerically the order parameter equations ()29l30l32j) . which here simplify to 

$(a;) = fdx' <l>{x')Y.^ fl[[dh,W{he)]6[x-A{Jo,x')-J2A{-,h,)] (53) 




Figure 2. Phase diagram in tlie (/3Jo,/?J) plane of tlie 'small world' magnet (i.e. 
uniform sparse long-range bonds), defined hy H = — Jo "'i'^'i+i ^ i^i<j '^ij'^i'^j- 
Solid lines: P^F transition lines for c = -1,1,4,16 (from right to left). Dashed 
vertical lines: asymptotic values (3Jq = log(l/-y/c) at which the critical values of (3 J 
diverge (and below which no order is possible), for c = rj^, |, 1, 4 (from right to left). 
This diagram demonstrates the so called 'small world effect'. Along the axis PJ = we 
have a one-dimensional model, where there is no phase transition at finite temperature. 
Along the /3Jo = axis we have the random finitely connected graph, where a P^F 
transition is known to exist at /3J = iclog[(c-f l)/(c— 1)], provided c > 1 (i.e. above 
the percolation threshold). When the two structures are combined we always find a 
phase transition at finite temperature, for any value of c (however small). 



^{y) = fdy'^iy')^:^-^ fl[[<^heW{h,)]6[y-A{Jo,y'+j:M-,he))] (54) 

fc>o e=i e=i ^ 

W(h) = J dxdy ^{x)'^{y)6[h - x - y] (55) 

The results are shown in figure El for two choices of control parameters in the 
ferromagnetic region: for T = 1, c = 10, Jq = | and J = 1 (i.e. above the percolation 
threshold of the Possionian graph) and for T = |, c = |, Jq = 1 and ^ = | (i-e. below 
the percolation threshold). In the first case the effective field distributions are found to 
be smooth. For c < 1, however, the distributions are seen to be highly irregular. 



5.3. Comparison with simulations 

To complete our analysis for the small world magnet we have compared the predicted 
values for m and q of our solution as obtained by numerical solution of ()53I54I55|) . 
followed by evaluation of (j4H) . with the result of numerical simulation of the stochastic 
microscopic dynamics, taken to be of the conventional Glauber type and with N = 
10,000. In the present (non- frustrated) small world magnet equilibration is found to 
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Figure 3. Effective field distributions for the 'small world' ferromagnet (i.e. uniform 
sparse long-range bonds), defined hy H = —Jq '^i<^i+i ~ 7 Si<j '^ij^i'^j^ as obtained 
by numerical solution of the order parameter equations (|29I30I32|I in the ferromagnetic 
phase. Top row: distributions well above the percolation threshold of the Poissonian 
graph (T = 1, c = 10, Jo = \ and J — 1). Bottom row: distributions for a system 
below the percolation threshold and for more dominant chain bonds (T = |, c = i, 
Jo — 1 and J = |). Note that the vertical scales used in the two rows are not identical. 



be relatively easy to achieve, as a result of which the agreement between theory and 
experiment is found to be very good. Examples are shown in figure |3J for parameter 
values identical to those used earlier to produce the field distributions in figure El 

6. Small world spin glasses 

We finally work out our theoretical predictions for a 'small world' spin-glass, where 
the sparse long range bonds are truly random, and distributed according to p{Jij) = 
pS{Jij — J) + (1 — p)6{Jij + J). Without loss of generality we may take J > 0. 

6.1. The phase diagram 

The second order transition lines ()46|) and ()49|) now take the form 

P ^ F : 1 = c{2p - 1) tanh(— ) e^^^-^" (56) 

c 

P ^ SG : 1 = c tanh'^i—) cosh(2/5Jo) (57) 
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m, q 




t (iter /spin) t (iter/spin) 



Figure 4. Observables m (solid lines) and q (dashed lines) as measured during 

numerical simulations of the 'small world' magnet, for N = 10,000. Left: T = 1, 
c = 10, Jo = I arid J = 1. Here the theory predicts the equilibrium values m = 0.80 
and q = 0.65. Right: T = |, c = i, Jo = 1 and J = |. Here the theory predicts 
the equilibrimn values m ~ 0.98 and g ~ 0.96. In both cases equilibration is achieved 
relatively fast, and the agreement between theory and simulations is very good. 




0.00 



Figure 5. The possible phases of the 'small world' spin-glass for the different allowed 
combinations of the dimensionless control parameters c > (the average Poissonian 
connectivity) and p G [0, 1] (the probability of Jij = +J in the Poissonian bonds). 



Now both transitions may generally occur, dependent on the values of p and c, unless 
p < I where only the P— >SG transition is possible. For c — > oo we see that only the P— >F 
transition will remain. We will transform the above equations into the dimensionless 
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variables x = Jq/J and y = T/J, which gives for the P— i>F transition 



F : 



Xf = -y\og[{2p- l)ctanh(l/?/c)] 



-1 



{p>- only) (58) 



: 



-y\og[{2p-l)c 



-1 



oo : xp = -y\og[y/{2p- 1)] 



y 
y 

The line will intersect the x = axis aX y = 1 / clog \J [{2p — l)c+ l]/[(2p 
provided c < l/(2p — 1). The P^SG transition line now takes the form 



l)c-l], 



SG : 

y 
y 









= ^ylog 


: 


XSG = 


oo : 


XSG = 



— tanh (l/yc) 
ctanh^(l/?/c) 



y\og (1 + Vl-c2)/c 



+ 



(59) 

(c < 1 only) 



2/ log 2cy'^ 



+ 



Clearly, the physics for c > 1 will again be significantly different from that found for 
c < 1. If c < 1 one will have a P— s>SG transition for any y > 0, whereas for c > 1 it will 
only occur when y > 2/clog[(yc +1)/ (a/c — 1)]. The two transition lines can meet at 
a triple point, which is found to be the solution of 



triple point (x*, y* 



tanh(l/?/*c) = (2p- 1) 



l + A/l-c2tanh^(l/?/'^c) 



X* = ^y*log[{2p — l)ctanh(l/?/*c) 



1-1 



(60) 



Graphical inspection of the equation r = (2p— l)[l + Vl — c^r"^] shows that the necessary 
and sufficient existence condition for the triple point are: 



c < 1 : 2j9 - 1 < 



c > 1 



2p-l< — 
\/c 



(61) 



We may conclude, since lim^^oo xp/xsc = 0, that as long as p > ^ there will be a P— i>F 
transition, but that a P-^SG transition exists if and only if (j6T|l is satisfied (if not, the 
P— *-F transition will always happen first). Thus, the possible phases (dependent on the 
remaining energy- related control parameters T, J, Jq) are 



p 



< 



{P,SG} 



<p<Pc: {P,SG,F} p>p,: {P,F} 



where 



1 



Pc<l 



1 

2^2(1 + VT^) 



Pc>l 



1 1 

2 ^ Vc 



This is summarized in figure We are not yet able to determine the F-^SG transition 
(if both F and SG phases exist) analytically, since this would require us to solve our 
equations also below the P— i>F and/or P— i>SG transition temperatures. However we 
may put forward the conjecture (which seems reasonable on the basis of our experience 
with more conventional disordered spin models, e.g. [SHI EHl EHj), that, especially upon 
taking RSB into account (if needed), there will be no change of phase type after the 




Figure 6. Phase diagrams in the {Jq/ J,T/ J) plane for 'small world' spin glasses, i.e. 
ferromagnetic rings with random sparse long-range bonds with strengths distributed 
according to p{Jij) = p6[Jij - J] + (1 - p)S[Jij + J]. Here p € {j, |, |}. The P^F 
and P^SG transitions (solid lines) and the triple point follow from our theory. The 
F— s-SG transition (dashed) is obtained upon using the location of the triple point 
in combination with the conjecture that on lowering temperature the nature of the 
ordered phase will remain that which emerges at the onset. Top row: c = 4, well above 
the percolation threshold of the Poissonian graph. Bottom row: c = 1/4, well below 
the percolation threshold. Here neither the ring nor the Poissonian graph would have 
exhibited order, whereas the combination does (the 'small world' effect). 



onset of order as the temperature is lowered from T = oo to T = 0. This conjecture 
would predict the elusive F— >-SG transition to be the line segment in the (x, y) plane 
going from (x*,0) to {x*,y*), where the latter is the triple point (jHOI)- 

In figure IHl we show typical examples of the resulting phase diagrams in the 
{Jq/ J,T/ J) plane, probing systematically the regimes exhibited in figure El It should 
be noted that, in spite of the equivalent notation and the resulting temptation to make 
hasty comparisons, the parameter J only has a meaning identical to that in the SK spin- 
glass |2S], i-e. measuring the variance in the bonds, for p = \- The P— i>SG instability line 
is independent of in contrast to the P— >F one. We observe here that, as the fraction 
p of positive long-range bonds increases (for fixed connectivity c) from p < \ (where 
there can be no ferromagnetic phase) to larger values, the ferromagnetic phase becomes 
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Figure 7. Effective field distributions for 'small world' spin glasses, i.e. ferromagnetic 
rings with random sparse long-range bonds with strengths distributed according to 
p{Jij) = pS[Jij — J] + (1 — p)S[Jij + J]. Here we show examples for c = 10, i.e. well 
above the percolation threshold of the Poissonian graph, in the spin-glass phase, with 
p = 5/8. Top row: Jo/ J = 1/2 and T/J = 1/10 (here the presence of the ring is 
important). Bottom row: Jq/J — 1/32 and T / J ~ 1/8 (here the physics is dominated 
by the sparse long-range bonds). 



increasingly important, to the point where it destroys the spin-glass phase altogether. 
However, there is again a clear difference between c > 1, where even without the ring 
(i.e. for Jo = 0) an ordered state is possible, and c < 1 (below the percolation threshold 
of the Poissonian graph) where as in the case of the small world magnet it is the 'small 
world' effect which generates global order. 

6.2. Effective field distributions 

Also for the small world spin-glass we have solved numerically the order parameter 
equations ()29I30I32|) . resulting in figures [71 |H1 and IHl It will be clear that, especially 
at low temperatures and around or below the percolation threshold, the effective field 
distributions can acquire highly nontrivial shapes (especially when compared to the 
Gaussian effective field distributions which one typically finds in non-diluted bond- 
disordered spin models). Furthermore, increasing the bond strength Jq along the ring has 
the effect of changing field distributions from being smooth into more discretized shapes, 
similar to what is found in random field and random bond Ising chains El 132] • 
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Figure 8. Effective field distributions for 'small world' spin glasses, i.e. ferromagnetic 
rings with random sparse long-range bonds with strengths distributed according to 
P^Jij) = P^[Ji3 ~ J] + ^ P)^[Jij + A- Here we show examples for c = |, i.e. well 
below the percolation threshold of the Poissonian graph (where the 'small world' effect 
dominates), again in the spin-glass phase, with p = 5/8 and Jo/ J = 3/2. Top row: 
T/J = 1. Bottom row: T/J = 1/2. 





Figure 9. Effective field distributions for 'small world' spin glasses, i.e. ferromagnetic 
rings with random sparse long-range bonds with strengths distributed according to 
Pi'^ij) = pS[Jij — J] + (1 — p)(^[Jij + J]- Here we show examples for c — 2, i.e. just 
above the percolation threshold of the Poissonian graph, again in the spin-glass phase, 
with p = 3/4, Jo/ J = 1/16 and T/J = 1/4. 
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Figure 10. Observables m (solid lines) and q (dashed lines) as measured during 
numerical simulations of the 'small world' spin-glass for N = 10,000. We show 
equilibration in the ferromagnetic phase, below the percolation threshold of the 
Poissonian graph (p = 3/4, T — 1, c = 0.5, Jq — 2 and J = 0.5). Here the theory 
predicts the equilibrium values m ~ 0.84 and q ~ 0.83. Compared to the small world 
magnet, equilibration is harder to achieve, but the agreement between theory and 
simulations is still very good. 



6.3. Comparison with simulations 

We have finally compared the predicted values for m and q of our solution, as obtained 
by numerical solution of ()29|H()pH2j) . followed by evaluation of (jlH), with the result 
of numerical simulation of the stochastic microscopic dynamics (of the conventional 
Glauber type) with = 10,000. In contrast to the small world magnet, in the small 
world spin- glass equilibration is found to be not only much slower but also more subject 
to finite size fluctuations. However, the agreement between theory and experiment is 
still found to be very good. Examples are shown in figure E3 

7. Discussion 

In this paper we have analyzed Ising spin models on 'small world' lattices, consisting of 
a combination of a one- dimensional ferromagnetic periodic chain and a sparse (finitely 
connected) random Poissonian graph with (generally) random bonds, using the replica 
method. Upon making a replica symmetric ansatz, we have been able to diagonalize 
the relevant replicated transfer matrices, and thereby obtain explicit expressions for 
the asymptotic free energy per spin and the continuous transitions away from the 
paramagnetic phase to either a ferromagnetic or a spin-glass one. We believe our results 
to constitute the first rigorous solution for this type of hybrid random 'small world' Ising 
spin model (given the RS ansatz), of relevance therefore both in the context of 'small 
world' models as such, but also in terms of the methodology used (diagonalization of 
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Figure 11. Effective field distributions at zero temperature, for 'small world' magnets 
(i.e. ferromagnetic rings with random sparse long-range ferromagnetic bonds, top 
row) and for 'small world' spin glasses (i.e. ferromagnetic rings with random sparse 
long-range ±J random bonds). Parameters for the small world magnet are c — 10, 
Jq = J, and J — 1; for the small world spin-glass they are c=^, Jo = ^,J— 1 
and P = §■ These data strongly suggest that, whereas the small world magnet exhibits 
zero temperature effective field distributions containing only discrete delta-peaks, those 
found for small world spin-glasses have additional continuous pieces. This, in turn, 
might be regarded as evidence for the need to break replica symmetry ]^^'^\ . 



replicated transfer matrices, which should have broader applicability). We have applied 
our theoretical results to two specific cases: the 'small world' ferromagnet (sparse long- 
range bonds of uniform value) and the 'small world' spin-glass (sparse random ± J long- 
range bonds). For these two specific models we could draw explicit RS phase diagrams, 
and also demonstrate analytically the nontrivial so-called 'small world' effect: for any 
non-zero value of the bond strength Jq along the chain (however weak), and any non-zero 
average Poissonian connectivity c (even c < 1) there is always a finite temperature phase 
transition to an ordered state. We have carried out (a limited number of) simulation 
experiments, which are found to be in good agreement with our theory. 

As always, many interesting questions remain to be answered and extensions to 
be carried out. Firstly, it would be important to find out whether and how replica 
symmetry needs to be broken in the present model. On the one hand, the fact that the 
SG transition line in our model is not dependent on p (the probability for a long-range 
bond to be +J) might be seen as a reason to doubt the need for RSB, since it suggests 
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that in the present models frustration does not play a major role (since for p = 1 we 
would have all ferromagnetic long-range bonds, whereas for p = —1 they would be all 
anti- ferromagnetic). On the other hand, numerical evaluation of the various effective 
field distributions in our model at T = (see figure HT} reveals continuous contributions 
in the small world spin-glass, which one might take as evidence for RSB. Secondly, one 
might wonder about and investigate the extent and role of domain formation along the 
spin chain. Obvious generalizations of our present study would be to other types of 
long range bond disorder (e.g. Gaussian), other types of spin variables, non-Poissonian 
random graphs (adapting e.g. the methods of |^), to anti-ferromagnetic or disordered 
bonds along the one-dimensional chain (where on the basis of j21] one should expect 
to find first order transitions), and to include an analysis of correlation and response 
functions. In one-dimensional systems correlation functions are linked to the second- 
largest eigenvalue of the transfer matrix. Here we would therefore require further 
eigenvalues of the replicated transfer matrix; this calculation can be carried out using 
the formalism of jSE], and will be the subject of a future study. 
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